A prospective multiple case study of the impact of emerging scientific evidence on established colorectal cancer screening programs: a study protocol.

BackgroundHealth-policy decision making is a complex and dynamic process, for which strong evidentiary support is required. This includes scientifically produced research, as well as information that relates to the context in which the decision takes place. Unlike scientific evidence, this "contextual evidence" is highly variable and often includes information that is not scientifically produced, drawn from sources such as political judgement, program management experience and knowledge, or public values. As the policy decision-making process is variable and difficult to evaluate, it is often unclear how this heterogeneous evidence is identified and incorporated into "evidence-based policy" decisions. Population-based colorectal cancer screening poses an ideal context in which to examine these issues. In Canada, colorectal cancer screening programs have been established in several provinces over the past five years, based on the fecal occult blood test (FOBT) or the fecal immunochemical test. However, as these programs develop, new scientific evidence for screening continues to emerge. Recently published randomized controlled trials suggest that the use of flexible sigmoidoscopy for population-based screening may pose a greater reduction in mortality than the FOBT. This raises the important question of how policy makers will address this evidence, given that screening programs are being established or are already in place. This study will examine these issues prospectively and will focus on how policy makers monitor emerging scientific evidence and how both scientific and contextual evidence are identified and applied for decisions about health system improvement.MethodsThis study will employ a prospective multiple case study design, involving participants from Ontario, Alberta, Manitoba, Nova Scotia, and Quebec. In each province, data will be collected via document analysis and key informant interviews. Documents will include policy briefs, reports, meeting minutes, media releases, and correspondence. Interviews will be conducted in person with senior administrative leaders, government officials, screening experts, and high-level cancer system stakeholders.DiscussionThe proposed study comprises the third and final phase of an Emerging Team grant to address the challenges of health-policy decision making and colorectal cancer screening decisions in Canada. This study will contribute a unique prospective look at how policy makers address new, emerging scientific evidence in several different policy environments and at different stages of program planning and implementation. Findings will provide important insight into the various approaches that are or should be used to monitor emerging evidence, the relative importance of scientific versus contextual evidence for decision making, and the tools and processes that may be important to support challenging health-policy decisions

Paucity of qualitative research in general medical and health services and policy research journals: analysis of publication rates

Abstract Background Qualitative research has the potential to inform and improve health care decisions but a study based on one year of publications suggests that it is not published in prominent health care journals. A more detailed, longitudinal analysis of its availability is needed. The purpose of this study was to identify, count and compare the number of qualitative and non-qualitative research studies published in high impact health care journals, and explore trends in these data over the last decade. Methods A bibliometric approach was used to identify and quantify qualitative articles published in 20 top general medical and health services and policy research journals from 1999 to 2008. Eligible journals were selected based on performance in four different ranking systems reported in the 2008 ISI Journal Citation Reports. Qualitative and non-qualitative research published in these journals were identified by searching MEDLINE, and validated by hand-searching tables of contents for four journals. Results The total number of qualitative research articles published during 1999 to 2008 in ten general medical journals ranged from 0 to 41, and in ten health services and policy research journals from 0 to 39. Over this period the percentage of empirical research articles that were qualitative ranged from 0% to 0.6% for the general medical journals, and 0% to 6.4% for the health services and policy research journals. Conclusions This analysis suggests that qualitative research it is rarely published in high impact general medical and health services and policy research journals. The factors that contribute to this persistent marginalization need to be better understood

Strengthening Policy for First Nations Self-Determination in Health: An Analysis of Problems, Politics, and Policy Related to Medical Travel in Northwest Territories

Medical travel, where a patient travels to a larger centre for services not available in their home community, is a critical element of the Northwest Territories (NT) health care system. For residents with a valid NT health care card who do not have other coverage for medical travel, the territorial government administers some travel benefits through the NT Medical Travel Program as well as the federally funded non-insured health benefits program. The Gwich'in Tribal Council (GTC) recognizes that medical travel constitutes a major burden and presents extraordinary challenges for Gwich'in living in small remote communities in NT. In 2020, the GTC conducted research that suggests current policy and programs provide only partial access to care. Informed by Gwich'in medical travel stories and drawing from literature on the concepts of health care access, knowledge, power, and Indigenous rights, this article reframes prevailing understandings of the problems, politics, and policy associated with medical travel in NT. The authors contend that relevant and equitable medical travel in NT depends on policy-making that engages First Nations as equal partners with different levels of government and describe key considerations relevant to policymakers in NT and throughout Canada

How can diagnostic assessment programs be implemented to enhance inter-professional collaborative care for cancer?

BackgroundInter-professional collaborative care (ICC) for cancer leads to multiple system, organizational, professional, and patient benefits, but is limited by numerous challenges. Empirical research on interventions that promote or enable ICC is sparse so guidance on how to achieve ICC is lacking. Research shows that ICC for diagnosis could be improved. Diagnostic assessment programs (DAPs) appear to be a promising model for enabling ICC. The purpose of this study was to explore how DAP structure and function enable ICC, and whether that may be associated with organizational and clinical outcomes.MethodsA case study approach will be used to explore ICC among eight DAPs that vary by type of cancer (lung, breast), academic status, and geographic region. To describe DAP function and outcomes, and gather information that will enable costing, recommendations expressed in DAP standards and clinical guidelines will be assessed through retrospective observational study. Data will be acquired from databases maintained by participating DAPs and the provincial cancer agency, and confirmed by and supplemented with review of medical records. We will conduct a pilot study to explore the feasibility of estimating the incremental cost-effectiveness ratio using person-level data from medical records and other sources. Interviews will be conducted with health professionals, staff, and referring physicians from each DAP to learn about barriers and facilitators of ICC. Qualitative methods based on a grounded approach will be used to guide sampling, data collection and analysis.DiscussionFindings may reveal opportunities for unique structures, interventions or tools that enable ICC that could be developed, implemented, and evaluated through future research. This information will serve as a formative needs assessment to identify the nature of ongoing or required improvements, which can be directly used by our decision maker collaborators, and as a framework by policy makers, cancer system managers, and DAP managers elsewhere to strategically plan for and implement diagnostic cancer services

Developing a decision aid to guide public sector health policy decisions: A study protocol

<p>Abstract</p> <p>Background</p> <p>Decision aids have been developed in a number of health disciplines to support evidence-informed decision making, including patient decision aids and clinical practice guidelines. However, policy contexts differ from clinical contexts in terms of complexity and uncertainty, requiring different approaches for identifying, interpreting, and applying many different types of evidence to support decisions. With few studies in the literature offering decision guidance specifically to health policymakers, the present study aims to facilitate the structured and systematic incorporation of research evidence and, where there is currently very little guidance, values and other non-research-based evidence, into the policy making process. The resulting decision aid is intended to help public sector health policy decision makers who are tasked with making evidence-informed decisions on behalf of populations. The intent is not to develop a decision aid that will yield uniform recommendations across jurisdictions, but rather to facilitate more transparent policy decisions that reflect a balanced consideration of all relevant factors.</p> <p>Methods/design</p> <p>The study comprises three phases: a modified meta-narrative review, the use of focus groups, and the application of a Delphi method. The modified meta-narrative review will inform the initial development of the decision aid by identifying as many policy decision factors as possible and other features of methodological guidance deemed to be desirable in the literatures of all relevant disciplines. The first of two focus groups will then seek to marry these findings with focus group members' own experience and expertise in public sector population-based health policy making and screening decisions. The second focus group will examine issues surrounding the application of the decision aid and act as a sounding board for initial feedback and refinement of the draft decision aid. Finally, the Delphi method will be used to further inform and refine the decision aid with a larger audience of potential end-users.</p> <p>Discussion</p> <p>The product of this research will be a working version of a decision aid to support policy makers in population-based health policy decisions. The decision aid will address the need for more structured and systematic ways of incorporating various evidentiary sources where applicable.</p

The efficiency and effectiveness of utilizing diagrams in interviews: an assessment of participatory diagramming and graphic elicitation

Abstract Background This paper focuses on measuring the efficiency and effectiveness of two diagramming methods employed in key informant interviews with clinicians and health care administrators. The two methods are 'participatory diagramming', where the respondent creates a diagram that assists in their communication of answers, and 'graphic elicitation', where a researcher-prepared diagram is used to stimulate data collection. Methods These two diagramming methods were applied in key informant interviews and their value in efficiently and effectively gathering data was assessed based on quantitative measures and qualitative observations. Results Assessment of the two diagramming methods suggests that participatory diagramming is an efficient method for collecting data in graphic form, but may not generate the depth of verbal response that many qualitative researchers seek. In contrast, graphic elicitation was more intuitive, better understood and preferred by most respondents, and often provided more contemplative verbal responses, however this was achieved at the expense of more interview time. Conclusion Diagramming methods are important for eliciting interview data that are often difficult to obtain through traditional verbal exchanges. Subject to the methodological limitations of the study, our findings suggest that while participatory diagramming and graphic elicitation have specific strengths and weaknesses, their combined use can provide complementary information that would not likely occur with the application of only one diagramming method. The methodological insights gained by examining the efficiency and effectiveness of these diagramming methods in our study should be helpful to other researchers considering their incorporation into qualitative research designs

An exploratory cluster randomised controlled trial of knowledge translation strategies to support evidence-informed decision-making in local governments (The KT4LG study)

Background: Childhood overweight and obesity is the most prevalent and, arguably, politically complex child health problem internationally. Governments, communities and industry have important roles to play, and are increasingly expected to deliver an evidence-informed system-wide prevention program. However, efforts are impeded by a lack of organisational access to and use of research evidence. This study aims to identify feasible, acceptable and ideally, effective knowledge translation (KT) strategies to increase evidence-informed decision making in local governments, within the context of childhood obesity prevention as a national policy priority.Methods/Design: This paper describes the methods for KT4LG, a cluster randomised controlled trial which is exploratory in nature, given the limited evidence base and methodological advances. KT4LG aims to examine a program of KT strategies to increase the use of research evidence in informing public health decisions in local governments. KT4LG will also assess the feasibility and acceptability of the intervention. The intervention program comprises a facilitated program of evidence awareness, access to tailored research evidence, critical appraisal skills development, networking and evidence summaries and will be compared to provision of evidence summaries alone in the control program. 28 local governments were randomised to intervention or control, using computer generated numbers, stratified by budget tertile (high, medium or low). Questionnaires will be used to measure impact, costs, and outcomes, and key informant interviews will be used to examine processes, feasibility, and experiences. Policy tracer studies will be included to examine impact of intervention on policies within relevant government policy documents.Discussion: Knowledge translation intervention studies with a focus on public health and prevention are very few in number. Thus, this study will provide essential data on the experience of program implementation and evaluation of a system-integrated intervention program employed within the local government public health context. Standardised programs of system, organisational and individual KT strategies have not been described or rigorously evaluated. As such, the findings will make a significant contribution to understanding whether a facilitated program of KT strategies hold promise for facilitating evidence-informed public health decision making within complex multisectoral government organisations.<br /

Access to electronic health records by care setting and provider type: perceptions of cancer care providers in Ontario, Canada

<p>Abstract</p> <p>Background</p> <p>The use of electronic health records (EHRs) to support the organization and delivery of healthcare is evolving rapidly. However, little is known regarding potential variation in access to EHRs by provider type or care setting. This paper reports on observed variation in the perceptions of access to EHRs by a wide range of cancer care providers covering diverse cancer care settings in Ontario, Canada.</p> <p>Methods</p> <p>Perspectives were sought regarding EHR access and health record completeness for cancer patients as part of an internet survey of 5663 cancer care providers and administrators in Ontario. Data were analyzed using a multilevel logistic regression model. Provider type, location of work, and access to computer or internet were included as covariates in the model.</p> <p>Results</p> <p>A total of 1997 of 5663 (35%) valid responses were collected. Focusing on data from cancer care providers (N = 1247), significant variation in EHR access and health record completeness was observed between provider types, location of work, and level of computer access. Providers who worked in community hospitals were half as likely as those who worked in teaching hospitals to have access to their patients' EHRs (OR 0.45 95% CI: 0.24–0.85, p < 0.05) and were six times less likely to have access to other organizations' EHRs (OR 0.15 95% CI: 0.02–1.00, p < 0.05). Compared to surgeons, nurses (OR 3.47 95% CI: 1.80–6.68, p < 0.05), radiation therapists/physicists (OR 7.86 95% CI: 2.54–25.34, p < 0.05), and other clinicians (OR 4.92 95% CI: 2.15–11.27, p < 0.05) were more likely to report good access to their organization's EHRs.</p> <p>Conclusion</p> <p>Variability in access across different provider groups, organization types, and geographic locations illustrates the fragmented nature of EHR adoption in the cancer system. Along with focusing on technological aspects of EHR adoption within organizations, it is essential that there is cross-organizational and cross-provider access to EHRs to ensure patient continuity of care, system efficiency, and high quality care.</p

Factors affecting the implementation of complex and evolving technologies: multiple case study of intensity-modulated radiation therapy (IMRT) in Ontario, Canada

<p>Abstract</p> <p>Background</p> <p>Research regarding the decision to adopt and implement technological innovations in radiation oncology is lacking. This is particularly problematic since these technologies are often complex and rapidly evolving, requiring ongoing revisiting of decisions regarding which technologies are the most appropriate to support. Variations in adoption and implementation decisions for new radiation technologies across cancer centres can impact patients' access to appropriate and innovative forms of radiation therapy. This study examines the key steps in the process of adopting and implementing intensity modulated radiation therapy (IMRT) in publicly funded cancer centres and identifies facilitating or impeding factors.</p> <p>Methods</p> <p>A multiple case study design, utilizing document analysis and key informant interviews was employed. Four cancer centres in Ontario, Canada were selected and interviews were conducted with radiation oncologists, medical physicists, radiation therapists, and senior administrative leaders.</p> <p>Results</p> <p>Eighteen key informants were interviewed. Overall, three centres made fair to excellent progress in the implementation of IMRT, while one centre achieved only limited implementation as of 2009. Key factors that influenced the extent of IMRT implementation were categorized as: 1) leadership, 2) training, expertise and standardization, 3) collaboration, 4) resources, and 5) resistance to change.</p> <p>Conclusion</p> <p>A framework for the adoption and implementation of complex and evolving technologies is presented. It identifies the key factors that should be addressed by decision-makers at specific stages of the adoption/implementation process.</p

A multidisciplinary systematic review of the use of diagrams as a means of collecting data from research subjects: application, benefits and recommendations

BACKGROUND: In research, diagrams are most commonly used in the analysis of data and visual presentation of results. However there has been a substantial growth in the use of diagrams in earlier stages of the research process to collect data. Despite this growth, guidance on this technique is often isolated within disciplines. METHODS: A multidisciplinary systematic review was performed, which included 13 traditional healthcare and non-health-focused indexes, non-indexed searches and contacting experts in the field. English-language articles that used diagrams as a data collection tool and reflected on the process were included in the review, with no restriction on publication date. RESULTS: The search identified 2690 documents, of which 80 were included in the final analysis. The choice to use diagrams for data collection is often determined by requirements of the research topic, such as the need to understand research subjects' knowledge or cognitive structure, to overcome cultural and linguistic differences, or to understand highly complex subject matter. How diagrams were used for data collection varied by the degrees of instruction for, and freedom in, diagram creation, the number of diagrams created or edited and the use of diagrams in conjunction with other data collection methods. Depending on how data collection is structured, a variety of options for qualitative and quantitative analysis are available to the researcher. The review identified a number of benefits to using diagrams in data collection, including the ease with which the method can be adapted to complement other data collection methods and its ability to focus discussion. However it is clear that the benefits and challenges of diagramming depend on the nature of its application and the type of diagrams used. DISCUSSION/CONCLUSION: The results of this multidisciplinary systematic review examine the application of diagrams in data collection and the methods for analyzing the unique datasets elicited. Three recommendations are presented. Firstly, the diagrammatic approach should be chosen based on the type of data needed. Secondly, appropriate instructions will depend on the approach chosen. And thirdly, the final results should present examples of original or recreated diagrams. This review also highlighted the need for a standardized terminology of the method and a supporting theoretical framework